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Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event however, may a reply be timely filed 
after SIX f6* MONTHS from the mailing date of this communication. 

- ff me period for reply srSed above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days w,ll be considered tmely. 

- I £o K for repl£ isl^ecified above, the maximum statutory period will appty and will expire SIX (6) commumcation. 

- Failureto reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.G § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment See 37 CFR 1.704(b). 

Status 

I) ^ Responsive to communication(s) filed on 12 August 1999 . 
2a)D This action is FINAL. 2bM This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1, 453 O.G. 213. 
Disposition of Claims 

4) EI Claim(s) Wi is/are pending in the application. 
4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-3, 5-8 is/are rejected. 

7) E3 Claim(s) 4 is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)13 The drawing(s) filed on 10 November 1999 is/are: a)EI accepted or b)Q objected to by the Examiner. 
Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

II) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§ 119 and 120 

13) S Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a)ia All b)D Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. Q Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Attachment(s) 

1) ^ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) Paper No(s). • 

2) E] Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-1 52) 

3) H information Disclosure Statement(s) (PTO-1 449) Paper No(s) 5 . 6) □ Other. 
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DETAILED ACTION 

1 . The action is responsive to communications: application filed 8/12/99. Foreign priority 
date 8/13/98 granted. 

2. Claims 1-8 are pending in the case. Claim 1 is an independent claim. 

Claim Rejections - 35 USC §101 

3. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or 
any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title. 

4. Claim 5 is rejected under 35 U.S.C. 101 as the claimed subject matter is directed to non- 
statutory subject matter. The body of the claim fails to recite a functional interrelationship 
between data elements within the multimedia document resulting in data per se. 

Claim Rejections - 35 USC § 112 

5. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

6. Claim 4 is rejected under 35 U.S.C. 112, second paragraph, as being indefinite for failing 
to particularly point out and distinctly claim the subject matter which applicant regards as the 
invention. The word method appears twice in the recited claim, but does not further limit the 
scope of the claim. The examiner's suggestion of changing said phrase to "in which the 
hierarchically-organized" and changing the second phrase to "and in which an event is 
constituted' will overcome this rejection. 

Claim Objections 
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7. Claims 1 & 5 are objected to because of the following informalities: The references to 
figures disclosed in the claims should be removed. Appropriate correction is required. 

In reference to dependent claims 4 & 8, the claims are objected to for including quotes around 
disclosed terms within the recited claims. The Examiner suggests removing quotes. 
In reference to independent Claim 5, the claim is objected to under 37 CFR 1.75(c), as being 
of improper dependent form for failing to further limit the subject matter of a previous claim. 
Applicant is required to cancel the claim(s), or amend the claim(s) to place the claim(s) in proper 
dependent form, or rewrite the claim(s) in independent form. The claim does not fall under an 
independent or dependent claim and seems to be written in independent form. The claim must be 
rewritten in dependent form or declared as an independent claim. Appropriate correction is 
required. 

Claim Rejections - 35 USC § 103 

8. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

9. Claims 1-9 Are rejected under 35 U.S.C. 103(a) as being unpatentable over Berry et al., 
U.S. Patent Number 5,692,205 filed (1 1/15/96), in view of Bugaj, 'Synchronized Multimedia 
Integration Language (SMIL) 1.0 Specification' W3C Recommendation, 6/15/98 and further in 
view of Seok Yun, 'Synchronization Attributes and Rules of Active Object-Oriented Database 
for Multimedia Presentation*, 1995. 
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In reference to independent claim 1, Berry discloses: 

Providing an improved method and system for providing selectable multimedia 
presentations within an object oriented user interface by means of diverse user selectable data 
views of each object (compare to "dynamically representing a multimedia document in a data- 
processing system via a software module"). See column 2, lines 22-27. 

Berry does not disclose a multimedia document being made up of a hierarchical- 
organized set of elements, themselves having attributes. However, Bugai discloses a 
Synchronized Multimedia Integration Language (SMIL), which is a markup language deployed 
on Web sites. SMILE was created specifically to solve the problems of coordinating the display 
of multimedia on Web sites. The reference teaches the utilization of hierarchical-organized sets 
of elements, which contain attributes. See Bugai, pages 1-6. It would have been obvious to one 
of ordinary skill in the art, having the teachings of Berry and Bugai before him at the time the 
invention was, to modify the multimedia presentation methods taught by Berry to include the 
Multimedia Integration Language methods of Bugai, because it would have provided the benefit 
of allowing the user proficient control over media elements within a multimedia document for a 
well-structured authoring environment. 

Bugai discloses attributes that specify the time for the explicit begin of an element. The 
attributes can contain two types of values. The element begins when a certain event occurs and 
its value is an element-event. See Bugai, page 1 1 . Bugai teaches actions being performed as a 
result of specific conditions; however, the reference does not explicitly disclose event-condition- 
actions (ECA) related to the attributes of a multimedia document. Yun discloses system 
responses, which are expressed using event-condition-action (ECA) rules. ECA rules have an 
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event that triggers the rule, a condition describing a given situation, and an action to be 
performed if the condition is satisfied. See Yun, page 359. The EC A described by Yun provides 
a proficient means of utilizing synchronication attributes within an object-oriented schema. With 
the addition of ECA's within a multimedia application, the user would have the ability to 
manipulate the representation of a markup document based on the document's elements. 
Therefore, it would have been obvious to one of ordinary skill in the art, having the combination 
of multimedia methods as disclosed by Berry and Bugaj to include the EC A rules of Yun, 
because it would have enhanced the multimedia capabilities of the multimedia integration 
language by utilizing an extended rule-set according to an element's attribute and provided 
actions performed as a result of specific conditions. 
In reference to dependent claim 2, Bugaj discloses: 

The attribute uniquely identifies an element within a document. Its value is an XML 
identifier. See Bugaj, pages 3-5. The unique identifiers describing attributes within the 
Synchronized Multimedia Integration Language are provided to differentiate multimedia 
structures. The utilization of identifiers as taught by Bugaj would have provided a proficient 
means of establishing associations between elements and formalisms as disclosed by Yun. 
Therefore, it would have been obvious to employ the combination of Berry and Bugaj to modify 
the multimedia techniques and include the event-condition-action of Yun for the added benefit of 
identifying elements as disclosed by Bugaj, and also the EC A as taught by Yun. 
In reference to dependent claim 3, Bugaj discloses: 

SMIL documents are XML 1.0 documents. See Bugaj, page 3. The description language 
disclosed by Bugaj would have provided a proficient method for describing multimedia 
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documents. It would have been obvious to one of ordinary skill in art, having the teachings of 
Berry and Bugaj before him at the time the invention was made, to modify the method and 
system for integration of multimedia presentations within an object oriented user interface as 
taught by Berry and included the XML specification of Bugaj, because it would have provided a 
well-structured document within a data processing system. 
In reference to dependent claim 4, Bugaj discloses: 

SMIL documents, which are XML 1.0 documents. See Bugaj, page 3. The description language 
disclosed by Bugaj demonstrate the utilization of hierarchically-organized sets of elements 
having attributes. It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have modified the method and system for integration of multimedia 
presentations of Berry and included the utilization of XML documents as disclosed by Bugaj, 
because it would have provided an efficient document processing system within a network 
environment. 

Berry and Bugaj do not explicitly teach the formalisms associated with event-condition-actions. 
However, Yun discloses system responses, which are expressed using event-condition-action 
(ECA) rules. ECA rules have an event that triggers the rule, a condition describing a given 
situation, and an action to be performed if the condition is satisfied. See Yun, page 359. The 
ECA described by Yun provides a proficient means of utilizing synchronication attributes within 
an object-oriented schema. With the addition of ECA's within a multimedia application, the user 
would have the ability to manipulate the representation of a markup document based on the 
document's elements. Therefore, it would have been obvious to one of ordinary skill in the art, 
having the combination of multimedia methods as disclosed by Berry and Bugaj to include the 
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ECA rules of Yun, because it would have enhanced the multimedia capabilities of the 
multimedia integration language by utilizing an extended rule-set according to an element's 
attribute and provided actions performed as a result of specific conditions. 
In reference to independent claim 5, Bugaj discloses: 

SMIL documents, which are XML 1.0 documents. See Bugaj, page 3. The description 
language disclosed by Bugaj demonstrate the utilization of hierarchically-organized sets of 
elements having attributes. It would have been obvious to one of ordinary skill in the art at the 
time the invention was made to have modified the method and system for integration of 
multimedia presentations of Berry and included the utilization of XML documents as disclosed 
by Bugaj, because it would have provided an efficient document processing system within a 
network environment. 

Berry and Bugaj do not explicitly teach the formalisms associated with event-condition- 
actions. However, Yun discloses system responses, which are expressed using event-condition- 
action (ECA) rules. ECA rules have an event that triggers the rule, a condition describing a given 
situation, and an action to be performed if the condition is satisfied. See Yun, page 359. The 
ECA described by Yun provides a proficient means of utilizing synchronication attributes within 
an object-oriented schema. With the addition of ECA' s within a multimedia application, the user 
would have the ability to manipulate the representation of a markup document based on the 
document's elements. Therefore, it would have been obvious to one of ordinary skill in the art, 
having the combination of multimedia methods as disclosed by Berry and Bugaj to include the 
ECA rules of Yun, because it would have enhanced the multimedia capabilities of the 
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multimedia integration language by utilizing an extended rule-set according to an element's 
attribute and provided actions performed as a result of specific conditions. 
In reference to dependent claims 6-8, the claims recite similar claim limitations to that of 
claims 1-3, and are therefore rejected under similar rationale. 

Conclusion 

10. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

Baleh US Patent No. 6,141,001 filed (08/20/97) 

Kiyono et al. US Patent No. 6,137,483 filed (1 1/27/96) 

Ingo Macherius, 'Experts Revolution', 6/1997, pages 1-8. 

1 1 . Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Matthew J. Ludwig whose telephone number is 703-305-8043. 
The examiner can normally be reached on 8:00am-5:00pm. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather Herndon can be reached on 703-308-5 1 86. The fax phone numbers for the 
organization where this application or proceeding is assigned are 703-746-7239 for regular 
communications and 703-746-7238 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-305-4700. 

ML 

May 19, 2003 




